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BACKGROUND  AND  METHOD 


The  results  of  a media  mix  test  involving  paid  radio  have  already  been 
fully  reported  in  a two  volune  report  entitled  "A  Media  Mix  Test  of  Paid 
Radio  Advertising  for  Armed  Services  Recruitment."  However,  at  the  time 
that  the  report  was  submitted  data  on  Public  Service  Announcements  were 
not  available  for  analysis.  It  was  at  least  theoretically  possible  that 
the  conclusions  reached  would  have  to  be  modified  in  the  light  of  possible 
Public  Service  Announcement  effects  on  the  criterion  measures. 


For  example,  if  radio  station  owners  decided  to  do  their  best  to  demon- 
strate the  full  effectiveness  of  radio  as  a medium  they  could  conceivably 
increase  the  number  of  Public  Service  Announcements  in  markets  where 
services  were  buying  radio.  Conversely,  they  might  reason  that  because 
the  services  were  buying  spots  it  was  no  longer  necessary  to  donate  time 
for  Public  Service  Announcements.  Or  they  might  behave  normally  and 
neither  significantly  increase  nor  significantly  decrease  their  Public 
Service  Announcements. 


To  check  what  had  actually  happened  the  A.C.  Nielsen  Co.  was  engaged  to 
audit  the  station  logs  of  radio  and  television  stations  in  test  and  control 
markets.  The  tables  included  In  this  report  have  been  drawn  from  the 
worksheets  of  that  organization. 


The  first  four  tables  sunmarlze  dollar  equivalents  for  Public  Service 
Announcements  for  test  and  control  markets  for  each  of  the  four  services. 
Considerable  market  to  market  variation  Is  evident.  Averages  per  market 
show  that  for  two  services  (Air  Force  and  Navy)  the  test  markets  outper- 
formed control  markets  with  respect  to  changes  observed  between  the  base 
period*  and  the  test  period.  However,  In  the  case  of  the  other  two  services 
(Army  and  Marines)  the  control  markets  fared  better  than  the  test  markets. 
Thus,  no  clearcut  pattern  Is  evident  concerning  possible  effects  of  Public 
Service  Announcements. 


* Note  that  the  base  period  Is  somewhat  longer  than  that  utilized  in  the 
main  report,  extending  from  May  1.,  1975  to  August  31,  1975 
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Test  Market 


Kansas  City 
Altoona 


Colunbus 

Atlanta 

Louisville 

Seattle 

Total 

Average 

Control  Markets 


DOLLAR  EQUIVALENTS  OF 
PUBLIC  SERVICE  ANNOUNCEMENTS  AIRED 


Test  - Base 

Base  Period*  Test  Period**  Difference 


Portland 

2745 

Total 

10,515 

Average 

2629 

May  1,  1975  to  August  31,  1975 

September  8,  1975  to  December  31,  1975 

Kansas  City 
Valdosta 
Baton  Rouge 
Louisville 
Seattle 


Control  Market 


Shreveport 

3472 

Portland 

1068 

Charleston 

1553 

Total 

6164 

Average 

1541 

May  1,  1975  to  August  31,  1975 
September  8,  1975  to  December  31,  1975 
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DOLLAR  EQUIVALENTS  OF 
PUBLIC  "SERVICE  ANNOUNCEMENTS  AIRED 


Test  Market 


Test  - Base 

Base  Period*  Test  Period**  Difference 
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PSA  - Nunber  of  Announcements 


If  the  number  of  Public  Service  Announcements  aired  is  examined  rather 
than  the  dollar  equivalents,  a similar  erratic  pattern  is  evident.  For 
two  services  (Air  Force  and  Marines)  the  test  markets  show  better  per- 
formance than  control  markets.  However,  for  the  remaining  two  services 
(Army  and  Navy)  the  control  markets  out  performed  the  test  markets. 

Note  that  the  results  between  numbers  of  announcements  and  dollar  equivalents 
are  also  inconsistent.  Only  the  Air  Force  (a  positive  effect  for  test 
markets)  and  the  Army  (a  negative  effect  for  the  test  markets)  show  con- 
sistent directions  of  change,  and  they  are  in  opposite  directions. 

The  following  four  tables  sunmarize  the  results  for  numbers  of  announcements. 
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NUMBER  OF 
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Test  Market 

NUMBER  OF 

PUBLIC  SERVICE  ANNOUNCEMENTS  AIRED 
(ARMY) 

Test  - Base 

Base  Period* 

Test  Period** 

Difference 

Denver 

4 

4 

0 

Kansas  City 

139 

67 

- 72 

Altoona 

96 

2 

- 94 

Spokane 

285 

7 

-278 

Col  unbus 

36 

19 

- 17 

Atlanta 

335 

183 

-152 

Louis vi lie 

22 

9 

- 13 

Seattle 

38 

60 

+ 22 

Total 

955 

351 

Average 

119 

44 

- 75 

Control  Market 

Albany 

1 

0 

- 1 

Yakima 

2 

2 

0 

Omaha 

108 

37 

- 71 

Portland 

102 

18 

- 84 

Total 

213 

57 

Average 

53 

14 

- 39 

* May  1,  1975  to  August  31,  1975 

**  September  8,  1975  to  December  31,  1975 
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Shreveport 

62 

Portland 

52 

Charleston 

130 

Total 

248 

4 

Average 

62 

May  1,  1975  to  August  31,  1975 
September  8,  1975  to  December  31,  1975 


NUMBER  OF 

PUBLIC  SERVICE  ANNOUNCEMENTS  AIRED 
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I 

I 


Twry 


Test  Market 

Base  Period* 

Test  Period** 

Test  - Base 
Difference 

Valdosta 

105 

4 

-101 

Baton  Rouge 

595 

105 

-490 

Altoona 

0 

6 

+ 6 

Spokane 

52 

255 

+203 

Louisville 

14 

5 

- 9 

Seattle 

32 

51 

+ 19 

Lansing 

69 

10 

- 59 

Knoxville 

53 

253 

+200 

Total 

920 

689 

Average 

115 

86 

- 29 

Control  Market 

Shreveport 

48 

40 

- 8 

Yakima 

40 

15 

- 25 

Portland 

13 

1 

- 12 

Binghamton 

4 

4 

0 

Total 

105 

60 

Average 

26 

15 

- 11 

♦May  1,  1975  to 

**  September  8, 

August  31,  1975 

1975  to  December  31,  1975 

11 
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Statistical  Analysis 

While  on  an  overall  basis  the  net  directions  of  change  show  no  consistent 
patterns  it  is  still  possible  that  market-to-market  changes  in  Public 
Service  Announcements  are  correlated  with  changes  in  one  or  more  of  the 
criterion  measures  for  one  or  more  of  the  four  services.  If  so,  it  might 
be  necessary  to  consider  a statistical  adjustment  of  the  results. 


To  test  this  possibility  thirty  two  regressions  were  run  - one  for  each 
of  the  four  services  for  each  of  the  four  criteria  and  for  numbers  of 
Public  Service  Announcements  and  for  dollar  equivalents.  In  each  regression  ■ 
the  criterion  measure  and  the  variable  representing  Public  Service  effort 

I 

were  treated  as  continuous  variables  and  the  test/control  condition  as 
a dummy  variable. 
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In  no  case  did  any  Public  Service  variable  reach  the  .05  level  of  statistical 
significance.  Results  are  summarized  in  the  following  table. 

Note  that  the  directions  of  association  are  also  diverse.  Eighteen  of 
the  coefficients  are  positive  while  fourteen  are  negative.  For  dollar 
equivalents  nine  are  positive  and  seven  negative.  Proportions  of  positive 
and  negative  signs  for  the  numbers  of  announcements  aired  are  Identical 
to  those  of  dollar  equivalents,  although  their  sources  vary  slightly. 

Again  no  consistent  patterns  are  evident. 
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12 
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■ 

Public 

I 

1 

Service 

Service  Measure 

iff 

1 

Air  Force 

Dollars 

m 

Units 

Army 

Dollars 

m 

Units 

Marines 

Dollars 

Units 

K 

Navy 

Dollars 

1 

Units 

1 

* T-Values  must 

reach  1.96  or  more  t 

Accessions 

Inquiries 

Attitudes 

Awareness 

1.12 

.10 

.83 

1.80 

.56 

-.36 

-1.02 

.02 

- .47 

.86 

-1.70 

-1.14 

-1.91 

1.30 

-1.10 

.14 

-1.43 

- .67 

.21 

.45 

- .62 

- .48 

- .07 

.79 

.57 

.68 

- .41 

- .22 

1.52 

.68 

.65 

.81 

be  statistically  significant  at  the  .05  level. 


CONCLUSIONS 


Findings  of  this  postscript  analysis  are  clearcut.  Nowhere  Is  there  any 
evidence  that  changes  In  levels  of  Public  Service  Announcements  had  any 
effect  on  any  of  the  performance  criteria.  Thus,  the  results  of  the 
original  analysis  stand  as  presented  In  the  original  Hay  report. 
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